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METHOD AND APPARATUS FOR OPTICAL ODOMETRY 

This application claims priority to provisional application 
#60/463,525, filed April 17, 2003, titled "Method and 
Apparatus for Optical Odometry" . 

Inventors: Kenneth Sinclair, Jay Gainsboro, Pace Willisson, 
Lee Weinstein 

Field of the Invention 
[001] The field of the invention relates to 

odometry, image processing, and optics, and more 
specifically to optical odometry. 

Background of the Invention 
[002] The dictionary defines an odometer as an 

instrument for measuring distance, and gives as a common 
example an instrument attached to a vehicle for measuring 
the distance that the vehicle travels. Indeed an odometer 
is a legally required instrument in all commercially sold 
vehicles. In passenger cars, the odometer may serve 
several useful functions. In one application, as a 
consumer purchases a used car, the odometer reading allows 
the consumer to measure how "used" a car actually is. In 
another application, a consumer may use a car odometer as a 
navigation aid when following a set of driving directions 
to get to a destination. In another application, a 
consumer may use odometer readings as an aid in calculating 
tax-deductible vehicle expenses. 

[003] Typical passenger car odometers function by 

directly measuring the accumulated rotation of the vehicles 
wheels. Such a direct-mechanical-contact method of 
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odometry is reliable in applications where direct no-slip 
mechanical contact is reliably maintained between the 
vehicle (wheels, treads, etc.) and the ground. In aircraft 
and ships, odometry is more typically accomplished through 
means such as GPS position receivers. For ground-based 
vehicles which experience significant wheel-slip in 
ordinary operation (such as farm vehicles, which may 
operate in mud) , wheel-rotation odometry is not necessarily 
an accurate measure of distance traveled (though it is 
certainly an adequate measure of wear on machinery) . Some 
companies engaged in the design of new autonomous 
agricultural vehicles have attempted to use GPS odometry, 
and have found it not to be accurate enough for many 
applications. Even when high-precision differential GPS 
measurements are employed, the time latency between 
receiving the GPS signal and deriving critical information 
such as velocity can be too long to allow GPS odometry to 
be used in applications such as velocity-compensated 
spreading of fertilizer, herbicides, and pesticides in 
agricultural applications. In addition, occasional 
sporadic errors in derived GPS position could make the 
difference between an autonomous piece of farm equipment 
being just outside your window, or in your living room. 

Summary of the Invention 
[004] In a preferred embodiment, the present 

invention measures change and position by measuring 
movement of features in a repeatedly-electronically- 
captured optical image of the ground as seen from a moving 
vehicle. In one embodiment, a downward- looking electronic 
imager is mounted to a vehicle. A baseline image is taken, 
and correlation techniques are used to compare the position 
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of features in the field of view in subsequent images to 
the position of those features in the baseline image. Once 
the shift in image position becomes large enough, a new 
baseline image is taken, and the process continues. In an 
alternate embodiment, an integrated optical navigation 
sensor (such as is used in an optical computer mouse) is 
fitted with optics to look at the ground below a moving 
vehicle. The optics provide the optical navigation sensor 
with an appropriately scaled image of a portion of the 
surface over which the vehicle is traveling, where the 
image is sufficiently in-focus that the navigation sensor 
can discern movement of surface texture features to produce 
accurate incremental X and Y position change information. 
Whether natural or artificial illumination is used, it is 
preferable in most applications that the optics give 
minimal attenuation to the portion of the illumination 
spectrum to which the image sensor is most sensitive. 

[005] The incremental X and Y position-change 

information from the navigation sensor is scaled and used 
as vehicle position change information. The system has no 
moving parts and is extremely mechanically rugged. In a 
preferred embodiment for use in dirty environment where 
airborne particles and moisture are present, a small 
optical aperture is used and the optical measurement is 
made through a hole through which an outward airflow is 
maintained to prevent environmental dirt or moisture from 
coming in contact with the optics. In another preferred 
embodiment for use in dirty environments, system optics are 
sealed in a housing and look out through a window which is 
automatically continuously cleaned (as in an embodiment 
with a rotating window with a stationary wiper) or 
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periodically cleaned (as in an embodiment with a stationary 
window and a moving periodic wiper) . 

[006] In a preferred high-accuracy embodiment, a 

telecentric lens is used to desensitize the system to 
image-scaling-related calculation errors. In an alternate 



o 

preferred embodiment, height measuring means 108 are O 



provided to sense height variations during operation, and 
image scaling distortion is estimated on the fly by 



UJ 
-J 
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normalizing the scaling of image data based on sensed ^ 

height over the imaged surface. In an alternate preferred ^ 

embodiment, dynamic height adjusting means 109 is driven to CO 

LU 

maintain a constant output from height measuring means 108 QQ 
so as to maintain imager 103 at a constant height above the 
surface being imaged, and thus maintain a constant image 
scale factor. 

[007] Height measuring means 108 may be optical or 

acoustic, or it may be electromechanical, or opto- 
mechanical. In the prior art, scale-variation-induced 
errors have been considered such a problem in the use of 
optical navigation sensors that the technical help staff of 
Agilent recommend against the use of the company's 
integrated optical navigation sensor for motion-sensing 
applications other than highly constrained applications 
such as a computer mouse . 

[008] It is an object of the present invention to 

provide an inexpensive, robust, earth-referenced method of 
odometry with sufficient accuracy to facilitate navigation 
of autonomous agricultural equipment, and sufficient 
accuracy to derive real-time vehicle velocity with enough 
precision to facilitate highly accurate automated velocity- 
compensated application of fertilizer, herbicides, 
pesticides, and the like in agricultural environments. It 
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is a further object of the present invention to provide 

accurate vehicle odometry information, even under 

conditions were vehicles wheels are slipping. It is a 

further object of the present invention to facilitate >* 

CL 

improved anti-skid safety equipment on cars and trucks. It Q 

o 

is a further object of the present invention to facilitate 
improved-performance wheeled vehicles in general, by gj 
facilitating improved traction control systems. It is a 
further object of the present invention to facilitate 
improved performance in all manner of ground-contact 
vehicles, by facilitating improved traction control 
systems, including anti-lock braking systems. It is a 
further object of the present invention to facilitate 
tracking and historical position logging of ground- 
traversing animals and objects, both indoors and outdoors. 
It is a further object of the present invention to provide 
increased accuracy of optical navigation sensors under 
conditions where the distance from the optical sensor to 
the surface being sensed is variable and imprecisely known. 
It is a further object of the present invention to 
facilitate inexpensive, reliable indoor navigation and 
odometry with bounded total error accumulation over time. 
It is a further object of the present invention to provide 
tracking and position sensing and related security data 
reporting for vehicles in combined outdoor /indoor 
applications. It is a further object of the present 
invention to facilitate inexpensive stress monitoring and 
historical and/or real-time tracking of loaned or rented 
vehicles. It is a further object of the present invention 
to facilitate tracking and navigation in indoor 
environments such as supermarkets, hospitals, and airports. 
It is a further object of the invention to facilitate 
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automated steering systems for autonomous and manned 
vehicles . 

Brief Description of the Drawings 

[009] FIG. 1A depicts a side view of a preferred 

embodiment of the present invention mounted on the front of 
a moving vehicle. 

[0010] FIG. IB depicts a side view of a preferred 
embodiment of the present invention mounted underneath a 
moving vehicle. 

[0011] FIG. 2 depicts a set of example pixel- 
pattern images acquired by the downward- looking electronic 
imager of the present invention. 

[0012] FIG. 3A depicts a bottom view of a vehicle 
equipped with a two- imager embodiment of the present 
invention, enabling high-resolution measurement of vehicle 
orientation change as well as vehicle position change. 

[0013] FIG. 3B depicts a set of example pixel- 
pattern images acquired by downward- looking imagers CI and 
C2. 

[0014] FIG. 4 depicts (for an an example 
acceleration and deceleration of a vehicle utilizing the 
present invention) the relationship between actual 
position, raw GPS readings, and the output of a Kalman 
filter used to reduce noise in raw GPS readings. 

[0015] FIG. 5 depicts (for the same acceleration 
profile used in FIG. 4) the GPS position error of the 
output of the Kalman filter, the GPS velocity derived from 
the output of the Kalman filter, and the GPS velocity 
error . 

[0016] FIG. 6 depicts a shopping cart equipped with 
the present invention. 



o 
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[0017] FIG. 7 depicts the layout of a grocery store 
equipped to provide automated item location assistance and 
other features associated with the present invention. 

[0018] FIG. 8 depicts a comparison between the 
optical behavior of a telecentric lens and the optical 
behavior of a non-telecentric lens. 

[0019] FIG. 9 is a schematic diagram of a preferred UJ 
embodiment of an optical odometer utilizing one or more CQ 
electronic image capture sensors. s£ 

[0020] FIG. 10 is a schematic diagram of a ^ 

preferred embodiment of an optical odometer utilizing one H> 

CO 

or more integrated optical navigation sensors. ill 

CO 



Detailed Descriptions of the Preferred Embodiments 
[0021] Figure 1A depicts a preferred embodiment of 
the imaging system of the present invention mounted on the 
front of the moving vehicle 100. Electronic imager 103 is 
mounted inside protective housing 104, which is filled with 
pressurized air 105, which is supplied by filtered air pump 
101. Electronic imager 103 looks out of housing 102 
through open window 106, and images field of view that is 
just beneath the front of moving vehicle V. Electronic 
imager 103 may be a black & white video camera, color video 
camera, CMOS still image camera, CCD still image camera, 
integrated optical navigation sensor, or any other form of 
imager that converts an optical image into an electronic 
representation. Sequentially acquired images are stored in 
computer memory. Data derived from sequentially acquired 
images is stored in computer memory. Within this document, 
the term "computer memory" shall be construed to mean any 
and all forms of data storage associated with digital 
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computing, including but not limited to solid-state memory 
(such as random-access memory), magnetic memory (such as 
hard disk memory) , optical memory (such as optical disk 
memory) , etc . 

[0022] In dirty environments such as may be present q! 

o 

around farm machinery, it is important to keep dirt from Q 
getting on the optics of the system in order to maintain t*J 
accuracy. Accuracy is somewhat impaired by airborne dirt, ^ 
mist, etc., but need not be cumulatively, degraded by 
allowing such contaminants to accumulate on the optics. ^ 



The continuous stream of pressurized air flowing out 
through window 106 serves to prevent contamination of the 
optics, thus limiting the optical "noise" to any airborne 
particles momentarily passing through the optical path. In 
figure 1A, natural lighting is relied upon to illuminate 
the field of view. 

[0023] Fig. IB depicts the preferred embodiment the 
present invention where electronic imager 103 looks out 
from beneath moving vehicle 100 at field of view 107, and 
field of view 107 is lit by lighting source 108, which is 
projected at an angle of approximately 45 degrees with 
respect to the vertical. By ensuring that a substantial 
fraction of the light illuminating the field of view comes 
from a substantial angle from the vertical, shadow detail 
in the image is enhanced. 

[0024] Figure 2 depicts three high-contrast pixel 
images acquired sequentially in time from electronic imager 
103. For the purposes of this illustration it is assumed 
that each pixel in the image is either black or white. 
Five black pixels are shown in image A, which is taken as 
the original baseline image. In image B, the pattern of 5 
black pixels originally seen in image A is seen shifted to 
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the right by three pixels and up by one pixel indicating 
corresponding motion of the vehicle in two dimensions. In 
addition, three new black pixels have moved into the field 
of view in image B. In image C, two of the original black 
pixels from image A are no longer in the field of view, all 
of the black pixels from image B are still present, and 
three new black pixels have come into the field of view. 
It can be seen that the pixels in image C which remain from 
image B have moved two pixels to the right and one pixel 
up, again indicating motion of the vehicle in two 
dimensions . 

[0025] In a preferred embodiment of the present 
invention, image A is taken as an original baseline 
position measurement. Relative position is calculated at 
the time of acquiring image B, by comparing pixel pattern 
movement between image A and image B. Many intermediate 
images may be taken and processed between image A and image 
B, and the relative motion in all of these intermediate 
images will be digitally calculated (by means such as a 
microprocessor, digital signal processor, digital 
application-specific integrated circuit, or the like) with 
respect to image A. By the time image C is acquired, a 
substantial fraction of the pixels which were originally 
present in image A are no longer present, so to maintain a 
reasonable level of accuracy, image B is used as the new 
baseline image, and relative motion between image B and 
image C is measured using image B is a baseline image. 

[0026] In a preferred embodiment of the present 
invention a number of images taken subsequent to the 
establishment of one baseline image and prior to the 
establishment of the next baseline image are stored, and a 
selection algorithm selects from among these stored images 
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which image to used as the new baseline image. The 
selection is done in such a way as to choose a new baseline 
image with the highest signal to noise ratio available, 
where "signal" includes pixels which are believed to be 

part of a consistent moving image of the ground, and ^ 

"noise" includes pixels which are believed to be q 

representative of transient objects moving through the UJ 

field of view (such as leaves, airborne bits of dirt etc.). 59 

[0027] In one application, the present invention s= 

may be used to perform odometry on autonomous agricultural ^ 

machinery, aiding in automated navigation of that fr^ 

machinery. In a preferred embodiment, position information W 



from the present invention is combined with GPS position 
information, resulting in high accuracy in both long- 
distance and short-distance measurements. 

[0028] In another application, the present 
invention is used to provide extreme high accuracy two- 
dimensional short distance odometry on a passenger car. 
When combined with wheel rotation sensors, the present 
invention enables accurate sensing of skid conditions and 
loss of traction on any wheel. 

[0029] In a preferred embodiment of the present 
invention, a solid-state video camera is used to acquire 
the sequential images shown in figure 1. Although the 
contrast of images shown in figure 1 is 100% (pixels are 
either black or white) , a grayscale image may also be used. 
When a grayscale image is used, the change in darkness of 
adjacent pixels from one image to the next may be used to 
estimate motion at a sub-pixel level. For maximum 
accuracy, it is desirable to use an imaging system with a 
large number of pixels of resolution, and to re-establish 
baseline images as far apart as possible. In a preferred 
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embodiment of the present invention, spatial calibration of 

the imaging system may be performed to improve accuracy and 

effectively reduce distortion. 

[0030] In an alternate preferred embodiment of the 

present invention, an integrated optical navigation sensor 

(such as is found in a typical optical computer mouse) is O 

used as imaging device 103 in figure 1, and X and Y motion j^j 

is estimated internal to the integrated optical navigation jfl 

sensor. In such an embodiment, digital processing is J 

< 

performed on x and y motion data output from one or more ^ 

< 

integrated optical navigation sensors over time. j_ 

[0031] Figure 9 is a schematic diagram of a [Jj 



preferred embodiment of an optical odometer according to 
the present invention. Optics 907 is positioned to image 
portion 909 of a surface onto image sensor 903. The potion 
of the surface imaged varies as the position of the optical 
odometer varies parallel to the surface. Electronically 
captured images from image sensor 903 are converted to 
digital image representations by analog-to-digital 
converter (A/D) 900. Data from sequentially captured 
images is processed in conjunction with timing information 
from clock oscillator 906 by digital processor 901 in 
conjunction with memory 905, to produce position and 
velocity information to be provided through data interface 
902. Since the odometers accuracy will be at best the 
accuracy of clock oscillator 906, clock oscillator 906 may 
be any electronic or electromechanical or electro-acoustic 
oscillator who's frequency of oscillation is stable enough 
that any inaccuracy it contributes to the system is 
acceptable. In a preferred embodiment, clock oscillator 
906 is a quartz-crystal-based oscillator, but any 



CD 



11 



Sinclair, et al., Optical Odometer RPA 2/24/2004 



Page 12 of 39 



electronic , electromechanical , electro-acoustic oscillator 
or the like with sufficient accuracy can be used. 

[0032] In applications where it is desirable for 
position and velocity information to include more accurate 
orientation information and rotational velocity 
information, additional image sensor 904 and optics 908 may 
be provided to image additional portion 910 of the surface 
over which the optical odometer is traveling. In 
applications where image sensor height variation with 
respect to the surface being imaged could induce undesired 
inaccuracies, height sensors 911 and 912 are added to 
either allow calculating means 901 to compensate for image- 
scale-variation-induced errors in software, or to 
electromechanically adjust sensor heights dynamically to 
maintain the desired constant image scale factor. 

[0033] In an alternate preferred embodiment shown 
in Fig. 10, an integrated optical navigation sensor 1000 
(such as is used in an optical mouse) is used and X & Y 
motion data from the integrated optical navigation sensor 
is processed by distance calculating means 901. In such an 
embodiment, if more accurate orientation and rotational 
velocity information is desired, a second integrated 
optical navigation sensor 1001 imaging a second portion of 
the surface over which the optical moves may be added. For 
applications where height-variation-induced image-scale 
variations would compromise accuracy, optics 907 and 908 
may be made substantially telecentric, and/or 
electromechanical height actuators 1002 and 1003 may be 
driven based on height measurement feedback from height 
sensors 912 and 911 (respectively) to maintain integrated 
optical navigation sensors 1001 and 1000 (respectively) and 
optics 908 and 907 (respectively) at consistent heights 
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above the imaged surface to maintain the desired image 
scale factors at the integrated optical navigation sensors. 

[0034] Digital processor 901 serves as distance 
calculating means and orientation calculating means in the 
above embodiments, and may be implemented as a 
microprocessor, a computer, a digital signal processing 
(DSP) chip, a custom or semi-custom digital or mixed-signal 
chip, or the like. 

[0035] Figure 3 depicts a vehicle equipped with a 
two-imager embodiment of the present invention, enabling 
high-resolution measurement of vehicle orientation change 
as well as vehicle position change. In a preferred 
embodiment, electronic imagers CI and C2 are spaced far 
apart about the center of vehicle V, each imager downward- 
facing with a view of the ground over which vehicle 100 is 
traveling. Accurate two-dimensional position change 
information at imager CI may be combined with accurate two- 
dimensional position change information at imager C2 to 
derive two-dimensional position and orientation change 
information about moving vehicle V. While orientation 
change information could be obtained from sequential 
changes in the image from either imager alone, use of two 
imagers allows highly accurate rotational information to be 
derived using imagers with relatively small fields of view. 
Treating movement of the images from each imager as (to a 
first approximation) consisting of only linear motion, and 
then deriving rotation from the linear motion sensed at 
each imager, a second (higher accuracy) linear motion 
measurement can be made at each imager once the first-order 
rotation rate has been estimated and can be compensated 
for . 
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[0036] In figure 3, the sequential images CI Image 

1 and CI Image 2 taken from imager CI, and the sequential 

images C2 Image 1 and C2 Image 2 taken from imager C2 

indicate that vehicle 100 is moving forward and turning to 

the right, because the rate of movement of the image seen ^ 

by the right imager (C2) is slower than the rate of O 

ill 

movement seen by the left imager (CI) . _j 

CD 

[0037] Orientation change information may be useful ^ 
for applications including autonomous navigation of 3 
autonomous agricultural equipment, automated multi-wheel ^ 
independent traction control on passenger cars (to (Jj 
automatically prevent vehicle rotation during emergency fl) 
braking) , etc . 

[0038] Other applications for the present invention 
include tread-slip prevention and/or warning systems on 
treaded vehicles (such as bulldozers, snowmobiles, etc.), 
traction optimization systems on railway locomotives, 
position measurement in mineshafts, weight-independent 
position measurements for shaft-enclosed or tunnel-enclosed 
cable lifts and elevators, race car position monitoring in 
race-track races (where an optical fiducial mark such as a 
stripe across the track can be used to regain absolute 
accuracy once per lap) , race car sideways creep as an 
indicator of impending skid conditions, navigation of 
autonomous construction vehicles and autonomous military 
vehicles, odometry and speed measurement and path recording 
for skiers, odometry and speed measurement and remote 
position tracking for runners in road races, automated 
movement of an autonomous print-head to print on a large 
surface (such as the a billboard, or the side of a building 
(for example for robotically painting murals) , or a wall in 
a house (for example for automatically painting on wall- 
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paper-like patterns)), replacement for grit-wheel 
technology for accurately repositioning paper in moving- 
paper printers, automated recording of and display of 
wheel-slip information for race car drivers, automated 
position tracking and odometry of horses in horse races, 
and automated navigation for road-striping equipment. 

[0039] When combined with a measurement which gives 
distance-above-bottom, the present invention can also be 
used for automated underwater two-dimensional position 
tracking for scuba divers, and automated navigation and 
automated underwater mapping and photography in shallow 
areas (for instance to automatically keep tabs on reef 
conditions over a large geographic area where a lot of 
sport diving takes place) . 

[0040] A preferred embodiment of the present 
invention used in a robotic apparatus for automatically 
painting advertising graphics on outdoor billboards further 
comprises automatic sensing of the color of the surface 
being painted on, so that only paint dots of the color and 
size needed to turn that color into the desired color (when 
viewed from a distance) would be added, thus conserving 
time, paint, and money. 

[0041] In preferred embodiment where airborne 
contaminants which could compromise the optics of 
electronic imager 103, a small-aperture optics system (such 
as the system previously described which looks out through 
a small hole in an air-pressurized chamber) is used. In 
preferred embodiments where high accuracy is needed in 
situations where the imaged surface is unpredictably uneven 
at a macroscopic level, an optical system employing a 
telecentric lens is employed. 



15 



Sinclair, et al w Optical Odometer RPA 2/24/2004 



Page 16 of 39 



[0042] The optical behavior of a telecentric lens 
is compared with the optical behavior of a non-telecentric 
lens in figure 8. Figure 8 illustrates optical ray tracing \ 
through a non-telecentric lens 801 with optical ray tracing cl 
through a telecentric lens group comprising lens 803 and q 
lens 804. Note that to traverse the field of view seen by 
image sensor 800, and object at distance Dl from imager 800 5 
need only travel distance D3 , whereas an object at distance — 
D2 from Imager 800 must travel distance D4, where Distance ^ 
D4 is greater than distance D3 . 

[0043] In contrast, note that to traverse the field ^ 
of view seen by image sensor 802, and object at distance Dl 
from imager 802 travels a distance D5, and an object at 
distance D2 from Imager 802 travels a distance D6, where 
distances D5 and D6 equal. Thus objects traversing the 
field of view close to a telecentric lens at a given 
velocity move across the image at the same rate as objects 
traversing the field of view further from the lens at the 
same velocity (unlike a conventional lens, where closer 
objects would appear to traverse the field of view faster) . 

[0044] It is also possible to design a lens system 
that has more telecentricity than a regular lens, but not 
as much telecentricity as a fully telecentric lens. To see 
this, note that the geometry of lens 804 could be altered 
such that rays 807 and 808 were not parallel, but were 
still more parallel than rays 805 and 806. In an optical 
odometer application where the distance between the surface 
being imaged and the imager is not precisely known, 
increasing the degree of telecentricity of the optics of 
the imager increases the accuracy of the optical odometer. 
A degree of telecentricity sufficient to reduce the 
potential error in a given application by 30% would be 
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considered for the purposes of this document to be a 
substantial degree of telecentricity . 

[0045] Since it is an optical requirement that the 
aperture of a telecentric lens be as big as its field of 
view, the optical aperture through which imager 103 
acquires its image may be larger in preferred embodiments 
where high accuracy optical odometry is desired on 
unpredictably uneven surfaces, such as may be the condition 
in agricultural applications, underwater applications, etc. 

[0046] In a preferred embodiment for use in 
precision farming, optical odometry is combined with GPS 
position sensing. Optical odometer readings provide 
accurate high-bandwidth velocity measurements, allowing 
more precise rate-compensated application of fertilizer and 
other chemicals than would be possible using GPS alone. 

[0047] In Figure 4, position profile 400 depicts an 
ideal accurate plot of position versus time for a piece of 
farm equipment moving in a straight line, first undergoing 
acceleration, then deceleration, then acceleration again. 
Profile 401 depicts the raw GPS position readings taken 
over this span of time from a GPS receiver mounted on the 
moving equipment. Profile 402 depicts the output of a 
Kalman filter designed to best remove the noise from the 
GPS position signal. Because any filter designed to remove 
the noise from a noisy signal must look at the signal over 
some period of time to estimate and remove the noise, there 
is an inherent latency, and thus the output of the filter 
will at best be a delayed version of the ideal signal (in 
this case a position and/or velocity signal) . 

[0048] In figure 4, profile 400 depicts the actual 
time vs. position of a farm vehicle along an axis of 
motion, as the machine accelerates, decelerates, and 
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accelerates again. Profile 401 represents the noisy, 
slightly delayed "raw" output from a GPS receiver mounted 
on the moving vehicle. Profile 402 depicts a Kalman 
filtered version of profile 401. 

[0049] In figure 5, profile 500 depicts the actual 
real-time velocity vs. time for the position-time profile 
400. Profile 501 depicts the GPS position velocity error 
(at the Kalman filtered output) , and profile 502 depicts 
the GPS velocity error. Using optical odometry in 
combination with GPS according to the present invention, 
the combined position error and the combined velocity error 
may be reduced to negligible values. 

[0050] A delay in the feedback path of a control 
system can be thought of as limiting the bandwidth of the 
control system. GPS systems such as differential GPS may 
be used to provide absolute position information to within 
a finite bounded accuracy, given enough time. In the 
frequency domain, this can be thought of as position 
information that is usable down to DC, but is not usable 
for the needed spatial accuracy above some certain 
frequency. 

[0051] Since an optical odometer is inherently a 
differential measurement device, it accumulates error over 
distance. Thus over long periods of use, in the absence of 
fiducials to reset absolute accuracy, an optical odometer 
accumulates error without bound. Thus, in the frequency 
domain, an optical odometer can be thought of as providing 
information of sufficient accuracy above a certain 
frequency, and not below that frequency. In a preferred 
embodiment of the present invention for use in precision 
farming, information from an optical odometer (sufficiently 
accurate above a given frequency) is combined with 
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information from a GPS receiver (sufficiently accurate 
below a given frequency) to provide position information 
which is sufficiently accurate absolute position 
information across all frequencies of interest. 

[0052] One aspect of precision farming where 
accurate position and velocity information is desirable at 
a higher bandwidth than can be obtained from GPS alone is 
the precise position-related control of concentration of 
fertilizer and other chemicals. Position and velocity 
errors in the outputs of GPS systems during acceleration 
and deceleration (such as the errors shown in Figure 4) can 
lead to poor control of chemical deposition, and may lead 
to unacceptable chemical concentrations being applied. 

[0053] Another aspect of precision farming where 
the present invention has great utility is automatic 
steering. It is desirable in a number of applications in 
farming to drive machines in a line as straight as 
possible. Straighter driving can facilitate (for instance) 
tighter packing of crop rows, more efficient harvesting, 
etc. Due to unevenness of terrain and spatial variations 
in soil properties, maintaining a straight course can take 
more steering in agricultural situations than on a paved 
surface. In addition, the abruptness of some changes in 
conditions can call for fast response if tight tolerances 
are to be maintained. Typical response delays for human 
beings are in tenths of a second, whereas automated 
steering systems designed using the present invention can 
offer much higher bandwidth. Thus, the present invention 
may be used to maintain equipment on a straighter course 
than would be possible under unassisted human control, and 
a straighter course than would be possible under currently 
available GPS control. 
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[0054] In a preferred embodiment of the present 
invention, optical odometry is used in conjunction with 
optically encoded fiducial marks to provide position 
tracking and navigation guidance in a product storage area 
such as a warehouse or a supermarket. In one particularly 
economical embodiment employing integrated optical 
navigation sensors, optical stripe fiducials may be 
detected by processing the brightness output from the 
integrated optical navigation sensor chips. 

[0055] In other indoor/outdoor embodiments of the 
present invention (such as embodiments facilitating the 
tracking luggage -moving vehicles and the like at airports, 
various types of fiducials may be used to periodically 
regain absolute position accuracy. Such fiducials may be 
optical (such as optically coded patterns on surfaces, 
which may be sensed by the same image sensors used for 
optical odometry) , or they may be light beams, RF tags, 
electric or magnetic fields, etc., which are sensed by 
additional hardware. 

[0056] Figure 6 depicts a supermarket shopping cart 
used in a preferred embodiment for use within a retail 
store. Optical odometer unit 601 is affixed to one of the 
lower rails of shopping cart 600, such that the optics of 
optical odometer unit 601 images part of the floor beneath 
shopping cart 600. Electrical contact strips 602 on the 
inside and outside of both lower shopping cart rails 
connect shopping carts in parallel for recharging when 
shopping carts are stacked in their typical storage 
configuration. In an alternate preferred embodiment, power 
is generated from shopping cart wheel motion to power all 
the electronics carried on the cart, so no periodic 
recharging connection is required. Scanner /microphone wand 
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604 serves a dual purpose of scanning bar codes (such as on 
customer loyalty cards and/or product UPC codes) and 
receiving voice input (such as "where is milk?"). Display 
603 provides visual navigation information (such as store 
map with the shopper's present position, and position of a SL 

o 

needed item) and text information (such as price Q 



information, or textual navigation information such as "go 
forward to the end of the isle, then right three isles, 



right again, and go 10 feet down the isle, third shelf ^? 

> 

up"), and may also provide this information in audio form. ^ 
The word "displaying" as used in the claims of this ^ 
document shall include presenting information in visual 
and/or audio form, and a "display" as referred to in the 
claims of this document shall include not only visual 
displays capable of displaying text and/or graphics, but 
also audio transducers such as speakers or headphones, 
capable of displaying information in audio form. Keyboard 
605 serves as an alternate query method for asking for 
location or price information on a product. Wireless data 
transceiver 60 6 communicates with a hub data transceiver in 
the supermarket, and may comprise wireless Ethernet 
transceiver or the like. It is contemplated that the 
present invention can be used equally well in any product 
storage area, including not only retail stores, but 
warehouses, parts storage facilities, etc. 

[0057] Figure 7 depicts a floor layout of a 
supermarket in an embodiment of the present invention, 
including entrance door, 700, exit door 701, and office and 
administrative area 702. Optically encoded fiducial 
patterns 705 encode reference positions along the "Y" axis 
in the store, and optically encoded fiducial patterns 706 
encode reference positions along the "X" axis in the store. 
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Diagonal fiducial pattern 707 provides initial orientation 

information when a shopping cart first enters the store, 

and as soon as the shopping cart crosses the first "X" 

fiducial, X position is known from the X fiducial and Y 

position is known from the known path traveled from the 

crossing of diagonal fiducial 707, and the unique distance ) 

between diagonal 707 and the first X fiducial for any given 1 ^ 

! o 

Y where the diagonal was first crossed. In a preferred j q 

» 

embodiment, optical odometry maintains accuracy of about 1% | 



of distance traveled between crossing fiducial marks, and 
position accuracy in the X and Y directions are reset each 



CO 

5 



■ s 

time X and Y fiducial marks are crossed, respectively. j ^ 

Information about product position on shelves 709 and isles ' 

i 

704 is maintained in central computer system 708. g 

[0058] In a preferred embodiment, the orientation 
of the shopping cart is taken into account automatically to 
estimate the position of the consumer who is pushing the 
cart, and all navigation aids are given relative to the 
estimated position of the consumer, not the position of the 
optical odometer on the cart. Thus, if the consumer turns 
the cart around such that optical odometer unit 601 rotates 
about its vertical axis, the assumed position of the 
consumer would move several feet. This allows automated 
guiding of a consumer to be within a foot of standing in 
front of the product he or she is seeking. 

[0059] In a preferred embodiment, the path a 
consumer takes through the store and the information the 
consumer requests through barcode /microphone wand 604 and 
keyboard 605 are stored as the consumer shops, and as the 
consumer enters a checkout lane, wireless data transmitter 
606 transmits to central computer 708 the identity of the 
cart which has entered the check-out lane, and the product 
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within the store. 

[0060] In a preferred embodiment, barcode scanner 
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purchase data from automated product identification 
equipment (such as UPC barcode scanners, RFID tag sensors, 
etc.) at checkout registers 703 is correlated with shopping 
path and timing information gathered from the optical 
odometer on the consumer's shopping cart, providing 
valuable information which can be used in making future 

o 

merchandising decisions on positions of various products O 

tu 

-I 
0Q 

3 

wand 604 may be used by the consumer to simply scan the 

> 

barcode of a coupon, and display 603 will automatically << 

display information guiding the consumer to the product to \j) 

LU 

which the coupon applies. In a preferred embodiment, qq 

barcode wand 604 or display 603 or keyboard 605 may also 

incorporate an IR receiver unit to allow consumers to 

download a shopping list from a PDA, and path optimization 

may automatically be provided to the consumer to minimize 

the distance traveled through the store (and thus minimize 

time spent) to purchase all the desired items. 

[0061] In a preferred embodiment, advice is also 
made available through display unit 603, in response to 
queries such as "dry white wine" . 

Applications of optical odometry: 

• Navigating in a warehouse. 

• Airport luggage cart that would guide you to your 
gate . 

• Self -guided robotic lawn mowers. 
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• Navigation of home robot after it has learned the 
environment of your house. 

• Localization and navigation system for blind person 
for an enclosed area or outdoors. 

• Automated navigation in buildings like hospitals to 
get people to where they want to go. 

• Tracking and reporting patient position in hospitals 
and nursing homes. 

• Toilet paper and paper towel usage measurement. 

• Measurement of velocities in fabric manufacture. 

• Using motion information while acquiring a GPS signal 
or in between loosing and re-acquiring a GPS signal, 
such that change in position is taken into account 
such that accurate position estimates can speed up 
acquisition process. 

• Tracking pets such as dogs and cats . 

• Tracking vehicle position at airports and on military 
bases, including inside buildings where GPS won't 
work . 

• Tracking or guiding people at amusement parks such as 
Disney World. 
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• Training of race car drivers. 

• Training during bobsledding & luge. 

• Market research applications on shopping carts. 

• Rental vehicle stress monitoring (speed, 
acceleration) . 

• Vehicle monitoring for parents (monitoring kids' 
speed, acceleration, routes) . 

• Navigation for scuba divers. 

• Skateboard odometer. 

• Railroad train odometer. 

• Variable-rate application of pesticides, herbicides, 
fertilizer, and the like, such as in precision farming 
applications . 

• Agricultural yield mapping combining harvest yield 
information with position information. 

• Assisted or automatic steering of tractors in 
applications such as precision farming. 

• Bounded absolute accuracy may be obtained by combining 
fiducial marks with optical odometry for increased 
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absolute position and distance accuracy. One method 
of recognizing fiducial marks comprises including 
contrast patterns (such as stripes) in the field of 
view of the optical odometry imaging system at known 
locations, such that the fiducials are sensed as part 
of optical odometer image capture process. Another 
method of recognizing fiducial marks comprises 
recognizing fiducial features with a separate image 
recognition video system, and combining with optical 
odometry. Another method of recognizing fiducial 
marks comprises recognizing fiducial reference light 
beams and combining with optical odometry. Other 
fiducial recognition systems include recognizing one 
or two dimensional bar codes, electric field sensing 
or magnetic field sensing which encode absolute 
position information . 

[0062] The foregoing detailed description has been 
given for clearness of understanding only, and no 
unnecessary limitation should be understood therefrom, as 
modifications will be obvious to those skilled in the art. 



